End of arm tools for soft robotic systems

ABSTRACT

Exemplary embodiments relate to unique structures for robotic end-of-arm-tools (EOATs). According to some embodiments, two or more fingers or actuators may be present on an EOAT, and the actuators may be configured to move (together or separately) to adjust the spacing between the actuators. Some aspects involve techniques for extending and/or retracting a vacuum cup present on the EOAT. Further embodiments, which may be used separately or in conjunction with the previously-described embodiments, apply a secondary inner grip pad to provide a secondary gripping mode for the EOAT. These embodiments may be particularly advantageous when the actuators are soft robotic actuators and the inner grip pad is a relatively more rigid structure than the actuators.

RELATED APPLICATIONS

This application claims priority to U.S. Provisional Patent ApplicationSer. No. 62/571,916, filed Oct. 13, 2017. This application is alsorelated to and is a Continuation-In-Part of U.S. patent application Ser.No. 15/411,212, filed Jan. 20, 2017, which claims priority to U.S.Provisional Patent Application Ser. No. 62/280,802, filed Jan. 20, 2016.The contents of the aforementioned applications are incorporated hereinby reference.

FIELD OF THE DISCLOSURE

The disclosure relates generally to the field of robotics andparticularly to novel structures robotic end-of-arm tools.

BACKGROUND

Robotic graspers are increasingly used to automate the retrieval ofitems from a warehouse. Typically, a warehouse includes many shelves,each containing a number of bins or totes storing items (e.g., itemsoffered for sale). When an order for items is received, the appropriateitems are retrieved from the bins or totes and packaged together forshipment.

Due to the size and shape of the totes or bins, the size, weight, andshape of items in the totes or bins, the variability in size, weight,and shape of items in the totes or bins and due to the relatively tightstorage constraints in a warehouse or an individual tote or bin,retrieving an item from one of the totes or bins may be difficult forconventional robotic systems. Often, robotic arms include bulkycomponents, or systems extending laterally from the body of the roboticarm, which make it difficult to navigate confined spaces.

SUMMARY

According to one aspect of an embodiment of the present invention, asoft robotic grasping system for grasping an article includes a gripperhub and a finger actuator that applies a first pressure change. Aplurality of soft robotic fingers each include an elastomeric outersurface surrounding an internal void, and each is configured to curl ina first degree of freedom when the finger actuator applies the pressurechange within the internal voids. Linkages respectively connect eachsoft robotic finger to the hub, and each is configured to guide in asecond degree of freedom to change a pose of the connected soft roboticfinger relative to the hub. Linkage actuators are configured to causethe linkages to move, each respectively connected to one of thelinkages. Fluid passage tubes provide fluid to the soft robotic fingers,each formed to move according to the linkages when the linkages arecaused to move, and configured to provide the pressure change to theinternal voids in any position reached by the plurality of soft roboticfingers according the first and second degrees of freedom.

Optionally, linkage fluid seals are formed about the linkages,permitting the linkages to move while sealing fluid flow to the fluidpassage tubes. Further optionally, a fluid seal about the hub retainsinterior fluid pressure. The finger actuator applies the pressure changeto the interior of the hub, and the pressure change is transmitted viathe linkage fluid seals and fluid passage tubes to the soft roboticfingers. Alternatively, or in addition, the system includes a suctionactuator that applies a second pressure change, and a suction cupconfigured to apply a suction force according to the second pressurechange. In this case, an extension linkage connects the suction cup andthe hub, and is configured to extend and retract to change a pose of thesuction cup to the hub. Optionally, a controller is configured toactivate the suction cup and extension actuator to cause the suction cupto contact the article, lift the article by the suction force, andretract the article toward the hub. The controller may activate thefinger actuator to cause the soft robotic fingers to curl to apply agrasping force to the article.

According to another aspect of an embodiment of the present invention, asoft robotic grasping system includes a gripper hub and a fingeractuator that applies a pressure change. One or more soft roboticfingers includes an elastomeric outer surface surrounding an internalvoid, each one configured to curl when the finger actuator applies thepressure change within the internal void. Linkages connect each softrobotic finger to the hub, each configured to move in a first degree offreedom to change a pose of the connected soft robotic finger relativeto the hub. A linkage actuator causes the linkage to move, the one ormore soft robotic fingers moving to grasp according to the combinedcurling and first degree of freedom. The first degree of freedom may beone of translation or rotation. Alternatively, or in addition, anastrictive effector applies an astrictive force and an extension linkageconnects the astrictive effector and the hub, and is configured toextend and retract to change a pose of the astrictive effector relativeto the hub.

In one variation, the first degree of freedom applies a clamping force,and the curling applies a grasping force. A controller may be connectedto each of the astrictive effector, the finger actuator and the linkageactuator, to activate the astrictive force, the clamping force, and thegrasping force in a predetermined order. Alternatively, the controllermay be configured to maintain the grasping force and clamping force in apredetermined relationship to one another.

According to one aspect of an embodiment of the present invention, asoft robotic grasping system includes a gripper hub and a fingeractuator that applies a pressure change. Soft robotic fingers aresupported by the hub, including an elastomeric outer surface surroundingan internal void, and configured to curl when the finger actuatorapplies the pressure change within the internal void. A camera has afield of view (and, e.g. focus) configured to observe the soft roboticfingers in any of an ungrasped, article grasping, and empty graspingstate. A controller connected to the camera and the finger actuator maycompare an observation of the soft robotic fingers to a reference stateto determine an ungrasped, article grasping or empty grasping state ofthe soft robotic fingers. The controller may further instruct the fingeractuator to apply pressure to change from an empty grasping state to anungrasped state after the empty grasping state is determined.

Optionally, the gripper hub may have an axial center region about anaxial center line, and the camera may be positioned in the axial centerregion, configured to direct the optical axis of the camera along theaxial center line. Alternatively, or in addition, an astrictive effectormay be configured to apply an astrictive force. An extension linkage mayconnect the astrictive effector and the hub, configured to extend andretract the astrictive effector along a direction perpendicular to thegrasping direction. The controller may compare an observation of thesoft robotic fingers and/or extension linkage to at least one referencestate to determine whether the article is successfully grasped.

Optionally, one or more linkages connecting each soft robotic finger tothe hub, each changing a pose of the connected soft robotic fingerrelative to the hub. In this case, the camera's a field of view andfocus may be configured to observe the soft robotic fingers in aplurality of poses of the connected soft robotic finger relative to thehub. Further optionally, the reference state may include a predeterminedproportion of the field of view corresponding to a recognizedcharacteristic (e.g., color, area) of the soft robotic fingers in theempty grasping state.

According to another aspect of an embodiment of the present invention, asoft robotic grasping system for grasping an article may include agripper hub, a finger actuator that applies a pressure change, and softrobotic fingers, each arranged along a grasping direction and includingan elastomeric outer surface surrounding an internal void. Each softrobotic finger may be configured to curl in a first degree of freedomalong the grasping direction when the finger actuator applies thepressure change within the internal void. An astrictive effector mayapply an astrictive force, and an extension linkage may connect theastrictive effector and the hub. The extension linkage may extend andretract the astrictive effector along a direction perpendicular to thegrasping direction. A camera may have a field of view and focusconfigured to observe the soft robotic fingers in any of an ungrasped,article grasping, and empty grasping state and the extension linkage inunextended and extended states. A controller connected to the camera maybe configured to compare an observation of the soft robotic fingersand/or extension linkage to at least one reference state to determinewhether the article is successfully grasped (and/or successfully pickedup by the astrictive effector).

Optionally, the gripper hub has an axial center region about an axialcenter line, and the camera is positioned in the axial center region andis configured to direct the optical axis along the axial center line. Inthis case, the astrictive effector and extension linkage may bepositioned adjacent the axial center region and configured to direct theextension of the astrictive effector parallel to the axial center line.Further optionally, linkages may respectively connecting the softrobotic fingers to the hub, each changing a pose of the connected softrobotic finger relative to the hub, and linkage actuators may beconfigured to cause the linkages to move, each linkage actuatorrespectively connected to one of the linkages,

According to a further aspect of an embodiment of the present invention,a soft robotic grasping system may include a gripper hub having an axialcenter region about an axial center line. A plurality of graspingdirections may be defined radially symmetric about the axial centerline, and a plurality of accessory directions may be defined betweenadjacent grasping directions. A finger actuator may apply a pressurechange, and soft robotic fingers, may be arranged along a graspingdirection. Each finger may include an elastomeric outer surfacesurrounding an internal void, and may curl in a first degree of freedomalong the grasping direction when the finger actuator applies thepressure change within the internal void. A first accessory may actalong the axial center line being positioned in the axial center region.A second accessory may act parallel to the axial center line. The secondaccessory may be positioned along an accessory direction adjacent theaxial center region. The first and second accessories may be selectedfrom a vacuum chuck extendible in a direction parallel to the axialcenter line, a camera having an optical axis extending in a directionparallel to the axial center line, and a range finder having a rangingaxis extending in a direction parallel to the axial center line. Anilluminator illuminating the field of view may also be one of the firstand second accessories.

Optionally, the camera may be positioned in the axial center region andconfigured to direct the optical axis along the axial center line. Inthis case, the vacuum chuck may be positioned adjacent the axial centerregion and configured to extend in the direction parallel to the axialcenter line. Alternatively, or in addition, linkages may respectivelyconnect soft robotic fingers to the hub, each configured to change apose of the connected soft robotic finger along the grasping direction.Further optionally, linkage actuators may cause the linkages to move,each linkage actuator respectively connected to one of the linkages.

According to an additional aspect of an embodiment of the presentinvention, a soft robotic grasping system for grasping an article mayinclude a gripper hub having robotic fingers. Each soft robotic fingermay include an elastomeric outer surface surrounding an internal void,and may curl in a first degree of freedom when the finger actuatorapplies the pressure change within the internal voids. Linkages mayrespectively connect each soft robotic finger to the hub, eachconfigured to guide in a second degree of freedom to change a pose ofthe connected soft robotic finger relative to the hub. Linkage actuatorsmay cause the linkages to move, each respectively connected to one ofthe linkages. A camera having a field of view may be configured toobserve the soft robotic fingers in any of an ungrasped, articlegrasping, and empty grasping state. A controller connected to the cameramay be configured to compare an observation of the soft robotic fingersto at least one reference state to determine whether the article issuccessfully grasped.

Optionally, an astrictive effector may be configured to apply anastrictive force, and an extension linkage may connect the astrictiveeffector and the hub, configured to extend and retract the astrictiveeffector along a direction perpendicular to the grasping direction. Thecamera may be further configured to observe the extension linkage inunextended and extended states, and a controller connected to the cameramay be configured to compare an observation of the extension linkage toat least one reference state. Further optionally, one or more referencestates may include a predetermined proportion of the field of viewcorresponding to a recognized characteristic of the soft robotic fingersin at least one of the ungrasped, article grasping, and empty graspingstate.

According to still another aspect of an embodiment of the presentinvention, a soft robotic grasping system for grasping an article mayinclude a finger actuator that applies a pressure change, and softrobotic fingers, each including an elastomeric outer surface surroundingan internal void. Each soft robotic finger may be configured to curl ina first degree of freedom when the finger actuator applies the pressurechange within the internal voids. Linkages may respectively connect eachsoft robotic finger to the hub, and may be configured to guide theconnected soft robotic finger in a second degree of freedom to change apose of the connected soft robotic finger relative to the hub. Grip padsmay be respectively connected to a translating member of each linkage,each configured to apply a clamping force when the translating member ismoved. Linkage actuators may cause the linkages to move, eachrespectively connected to one of the linkages. A controller may beconfigured to, in a first mode, activate the linkage actuators to causethe translating members of the linkages to move to apply the clampingforce to a first article, and in a second mode, activate the fingeractuator to cause the soft robotic fingers to curl to apply a graspingforce to a second article.

Optionally, the controller may be further configured, in a third mode,to activate the finger actuator to cause the soft robotic fingers tocurl to apply the grasping force to the second article and to activatethe linkage actuators to cause the translating members of the linkagesto move to apply a portion of the clamping force via the soft roboticfingers to the same second article. Further optionally, the controllermay be configured in the third mode to successively actuate one of thelinkage actuators or the finger actuators, then actuate the remainingone of the linkage actuators or the finger actuators to combine theportion of the clamping force and the grasping force. Still further, thecontroller may be further configured in the third mode to simultaneouslyactuate the linkage actuators and the finger actuators to combine theportion of the clamping force and the grasping force. Still yet further,the controller may be configured in the third mode to maintain thegrasping force and clamping force in a predetermined relationship to oneanother.

According to still yet another aspect of an embodiment of the presentinvention, a soft robotic grasping system for grasping an article mayinclude a finger actuator that applies a pressure change, and softrobotic fingers, each including an elastomeric outer surface surroundingan internal void. Each soft robotic finger may be configured to curl ina first degree of freedom when the finger actuator applies the pressurechange within the internal voids. Linkages, each respectively connectinga soft robotic finger to the hub, may be configured to guide theconnected soft robotic finger in a second degree of freedom to change apose of the connected soft robotic finger relative to the hub. Grippads, each respectively connected to a translating member of a linkage,may be configured to apply a clamping force when the translating memberis moved. Linkage actuators may cause the linkages to move, each linkageactuator respectively connected to one of the linkages. A controller mayactivate the linkage actuators to cause the translating members of thelinkages to move to apply the clamping force to an article, and mayactivate the finger actuators to cause the soft robotic fingers to curlto apply a grasping force to the article. The controller may beconfigured to, in a first mode, successively actuate one of the linkageactuators or the finger actuators then the remaining one of the linkageactuators or the finger actuators to combine the clamping force and thegrasping force, and in a second mode, simultaneously actuate the linkageactuators and the finger actuators to combine the clamping force and thegrasping force.

Optionally, the controller is further configured to maintain thegrasping force and clamping force in a predetermined relationship to oneanother. Further optionally, a suction cup may be configured to apply avacuum force to the article, the suction cup being mounted to theextension actuator and configured to move toward or away from the hub.The suction cup may create a vacuum force when the suction cup actuatorapplies the second pressure change, and the controller may be furtherconfigured to, in a third mode, activate the suction cup actuator andextension actuator to cause the suction cup to contact the article, liftthe article by the vacuum force, and retract the article toward the hub.The controller may alternatively or in addition be further configured tocomplete the third mode before the first or second mode. Further, thelinkages may move to apply a portion of the clamping force and thegrasping force via the soft robotic fingers to a same article.

According to yet another aspect of an embodiment of the presentinvention, a soft robotic grasping system for grasping an article mayinclude a gripper hub and a finger actuator that applies a firstpressure change. A suction cup actuator may apply a second pressurechange An extension actuator may extend away from or retracts toward thehub, and soft robotic fingers, may each including an elastomeric outersurface surrounding an internal void. Each soft robotic finger may beconfigured to curl in a first degree of freedom when the finger actuatorapplies the pressure change within the internal voids. A suction cup maybe configured to apply a vacuum force to the article. The suction cupmay be mounted to the extension actuator and configured to move towardor away from the hub, and may create a vacuum force when the suction cupactuator applies the second pressure change. A controller may beconfigured to, in a first mode, activate the suction cup actuator andextension actuator to cause the suction cup to contact the article, liftthe article by the vacuum force, and retract the article toward the hub,and in a second mode, activate the finger actuator to cause the softrobotic fingers to curl to apply a grasping force to the article.

Optionally, the controller is further configured to, in a third mode,complete the first mode before the second mode. Further optionally, thecontroller is configured to, in a fourth mode, start the second modebefore the first mode completely retracts the article toward the hub.The systems may alternatively, or in addition, include a camera having afield of view configured to observe the soft robotic fingers in any ofan ungrasped, article grasping, and empty grasping state. The controllermay be configured to compare an observation of the soft robotic fingersto a reference state to determine an ungrasped, article grasping orempty grasping state of the soft robotic fingers. The field of view ofthe camera may be further configured to observe the suction cup inretracted and extended states of the extension actuator. The controllermay be further configured to compare an observation of the suction cupto one or more one reference states to determine whether the article issuccessfully lifted.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A-1G depict various examples of soft robotic actuators.

FIGS. 2, 3A, and 3B depict side views of a robotic end-of-arm tool (EOATaccording to exemplary embodiments described herein.

FIGS. 4A-4D depict exemplary grasping techniques according to exemplaryembodiments.

FIGS. 5A-5B depict an exemplary technique for controlling an EOAT toprovide a self-optimizing gripping force.

FIG. 6 depicts a side view of an exemplary EOAT having a sensor packageand a vacuum cup.

FIG. 7 depicts a bottom view of the EOAT of FIG. 6.

FIGS. 8-9 depict perspective views of the EOAT of FIG. 6, in awide-actuator configuration and a narrow-actuator configuration,respectively.

FIGS. 10-12 depict various perspective views of the EOAT of FIG. 6.

FIGS. 13-16 are cross-sectional views showing an interior of theexemplary EOAT of FIG. 6.

FIGS. 17-18 depict various structures allowing a suction cup on an EOATto be efficiently retracted according to exemplary embodiments.

FIG. 19 is a flowchart describing an exemplary grasping technique inaccordance with exemplary embodiments.

FIGS. 20A-20C are schematic front and side views of a gripper hubshowing different locations for a suction cup and camera upon an EOAT.

FIGS. 21A-21C are schematic side views of a gripper hub showing fluidrouting and movable fluid passage tubes for an EOAT.

FIGS. 22A and 22B are schematic side views of a gripper hub system andgripper hub system including a robot arm, respectively, and showingfluid and electrical control connections and routing, including acontroller.

FIGS. 23A and 23B are schematic side views of a gripper hub system andarticle to be gripped, showing differing translation positions of softrobotic fingers as well as different curling positions of soft roboticfingers and extension positions of a vacuum cup.

FIGS. 24A and 24B are schematic side views of a gripper hub system andarticle to be gripped, showing differing rotation positions of softrobotic fingers as well as different curling positions of soft roboticfingers and extension positions of a vacuum cup.

FIGS. 25A through 25C are schematic bottom views of a differingarrangements of sensors and actuators along a gripping direction andaccessory direction, for a bilaterally symmetric gripper hub.

FIGS. 26A through 26C are schematic bottom views of a differingarrangements of sensors and actuators along a gripping direction andaccessory direction, for a trilaterally symmetric gripper hub.

FIGS. 27A through 27C are schematic side views of a gripper hub systemand article to be gripped in different states of gripping andobservation, together with corresponding fields of view of a camera onthe gripper hub.

FIGS. 28A through 28C are schematic side views of a gripper hub systemand article to be lifted in different states of suction lifting andobservation, together with corresponding fields of view of a camera onthe gripper hub.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The present invention will now be described more with reference to theaccompanying drawings, in which preferred embodiments of the inventionare shown. The invention, however, may be embodied in many differentforms and should not be construed as being limited to the embodimentsset forth herein. Rather, these embodiments are provided so that thisdisclosure will be thorough and complete, and will fully convey thescope of the invention to those skilled in the art. In the drawings,like numbers refer to like elements throughout.

Background on Soft Robotic Grippers

Conventional robotic actuators may be expensive and incapable ofoperating in certain environments where the uncertainty and variety inthe weight, size and shape of the object being handled has preventedautomated solutions from working in the past. The present applicationdescribes applications of novel soft robotic actuators that areadaptive, inexpensive, lightweight, customizable, and simple to use.

Soft robotic actuators may be formed of elastomeric materials, such asrubber, coated fabric, or thin walls of plastic arranged in an accordionstructure that is configured to unfold, stretch, twist, bend, extendand/or contract under pressure, or other suitable relatively softmaterials. As an alternative or in addition to accordion structures,other types or configurations of soft actuators employing elastomericmaterials may be utilized. They may be created, for example, by moldingor bonding one or more pieces of the elastomeric material into a desiredshape. Alternatively or in addition, different pieces of elastomericmaterial may be thermally bonded, or sewn. Soft robotic actuators mayinclude a hollow interior that can be filled with a fluid, such as air,water, or saline to pressurize, inflate, and/or actuate the actuator.Upon actuation, the shape or profile of the actuator changes. In thecase of an accordion-style actuator (described in more detail below),actuation may cause the actuator to curve or straighten into apredetermined target shape. One or more intermediate target shapesbetween a fully unactuated shape and a fully actuated shape may beachieved by partially inflating the actuator. Alternatively or inaddition, the actuator may be actuated using a vacuum to removeinflation fluid from the actuator and thereby change the degree to whichthe actuator bends, twists, and/or extends.

Actuation may also allow the actuator to exert a force on an object,such as an object being grasped or pushed. However, unlike traditionalhard robotic actuators, soft actuators maintain adaptive properties whenactuated such that the soft actuator can partially or fully conform tothe shape of the object being grasped. They can also deflect uponcollision with an object, which may be particularly relevant whenpicking an object off of a pile or out of a bin, since the actuator islikely to collide with neighboring objects in the pile that are not thegrasp target, or the sides of the bin. Furthermore, the amount of forceapplied can be spread out over a larger surface area in a controlledmanner because the material can easily deform. In this way, soft roboticactuators can grip objects without damaging them.

Still further, soft actuators are adaptive, and accordingly a singlefixture can grip multiple kinds of objects. Because the outer surfacesof soft actuators are relatively delicate, they can serve in roles suchas redirectors for easily bruised or damaged items (e.g., tomatoes)whereas hard fixtures might be limited to manipulating more robust items(e.g., brass valves).

Furthermore, soft actuators will typically not mark the surface beinggripped. Typically, when an easily-marked surface (e.g., a veneer) willbe gripped by a hard fixture, a protective coating or film may beapplied to prevent the part from being marked; this increases the costof manufacturing. With a soft actuator, this step may be omitted and thepart may be protected without a special coating or film.

Moreover, soft robotic actuators allow for types of motions orcombinations of motions (including bending, twisting, extending, andcontracting) that can be difficult to achieve with traditional hardrobotic actuators.

Conventional robotic grippers or actuators may be expensive andincapable of operating in certain environments where the uncertainty andvariety in the weight, size and shape of the object being handled hasprevented automated solutions from working in the past. The presentapplication describes applications of novel soft robotic actuators thatare adaptive, inexpensive, lightweight, customizable, and simple to use.

Soft robotic actuators may be formed of elastomeric materials, such asrubber, or thin walls of plastic arranged in an accordion structure thatis configured to unfold, stretch, and/or bend under pressure, or othersuitable relatively soft materials. They may be created, for example, bymolding one or more pieces of the elastomeric material into a desiredshape. Soft robotic actuators may include a hollow interior that can befilled with a fluid, such as air, water, or saline to pressurize,inflate, and/or actuate the actuator. Upon actuation, the shape orprofile of the actuator changes. In the case of an accordion-styleactuator (described in more detail below), actuation may cause theactuator to curve or straighten into a predetermined target shape. Oneor more intermediate target shapes between a fully unactuated shape anda fully actuated shape may be achieved by partially inflating theactuator. Alternatively or in addition, the actuator may be actuatedusing a vacuum to remove inflation fluid from the actuator and therebychange the degree to which the actuator bends, twists, and/or extends.

Actuation may also allow the actuator to exert a force on an object,such as an object being grasped or pushed. However, unlike traditionalhard robotic actuators, soft actuators maintain adaptive properties whenactuated such that the soft actuator can partially or fully conform tothe shape of the object being grasped. They can also deflect uponcollision with an object, which may be particularly relevant whenpicking an object off of a pile or out of a bin, since the actuator islikely to collide with neighboring objects in the pile that are not thegrasp target, or the sides of the bin. Furthermore, the amount of forceapplied can be spread out over a larger surface area in a controlledmanner because the material can easily deform. In this way, soft roboticactuators can grip objects without damaging them.

Still further, soft actuators are adaptive, and accordingly a singlefixture can grip multiple kinds of objects. Because the outer surfacesof soft actuators are relatively delicate, they can serve in roles suchas redirectors for easily bruised or damaged items (e.g., tomatoes)whereas hard fixtures might be limited to manipulating more robust items(e.g., brass valves).

Furthermore, soft actuators will typically not mark the surface beinggripped. Typically, when an easily-marked surface (e.g., a veneer) willbe gripped by a hard fixture, a protective coating or film may beapplied to prevent the part from being marked; this increases the costof manufacturing. With a soft actuator, this step may be omitted and thepart may be protected without a special coating or film.

Moreover, soft robotic actuators allow for types of motions orcombinations of motions (including bending, twisting, extending, andcontracting) that can be difficult to achieve with traditional hardrobotic actuators.

FIGS. 1A-1D depict exemplary soft robotic actuators. More specifically,FIG. 1A depicts a side view of a portion of a soft robotic actuator.FIG. 1B depicts the portion from FIG. 1A from the top. FIG. 1C depicts aside view of a portion of the soft robotic actuator including a pumpthat may be manipulated by a user. FIG. 1D depicts an alternativeembodiment for the portion depicted in FIG. 1C.

An actuator may be a soft robotic actuator 100, as depicted in FIG. 1A,which is inflatable with an inflation fluid such as air, water, saline,or any suitable liquid, gas, gel, foam, etc. The inflation fluid may beprovided via an inflation device 120 through a fluidic connection 118.

The actuator 100 may be in an uninflated state in which a limited amountof inflation fluid is present in the actuator 100 at substantially thesame pressure as the ambient environment. The actuator 100 may also bein a fully inflated state in which a predetermined amount of inflationfluid is present in the actuator 100 (the predetermined amountcorresponding to a predetermined maximum force to be applied by theactuator 100 or a predetermined maximum pressure applied by theinflation fluid on the actuator 100). The actuator 100 may also be in afull vacuum state, in which all fluid is removed from the actuator 100,or a partial vacuum state, in which some fluid is present in theactuator 100 but at a pressure that is less than the ambient pressure.Furthermore, the actuator 100 may be in a partially inflated state inwhich the actuator 100 contains less than the predetermined amount ofinflation fluid that is present in the fully inflated state, but morethan no (or very limited) inflation fluid.

In the inflated state, the actuator 100 may exhibit a tendency to curvearound a central axis as shown in FIG. 1A. For ease of discussion,several directions are defined herein. An axial direction passes throughthe central axis around which the actuator 100 curves, as shown in FIG.1B. A radial direction extends in a direction perpendicular to the axialdirection, in the direction of the radius of the partial circle formedby the inflated actuator 100. A circumferential direction extends alonga circumference of the inflated actuator 100.

In the inflated state, the actuator 100 may exert a force in the radialdirection along the inner circumferential edge of the actuator 100. Forexample, the inner side of the distal tip of the actuator 100 exerts aforce inward, toward the central axis, which may be leveraged to allowthe actuator 100 to grasp an object (potentially in conjunction with oneor more additional actuators 100). The soft robotic actuator 100 mayremain relatively conformal when inflated, due to the materials used andthe general construction of the actuator 100.

The actuator 100 may be made of one or more elastomeric materials thatallow for a relatively soft or conformal construction. Depending on theapplication, the elastomeric materials may be selected from a group offood-safe, biocompatible, or medically safe, FDA-approved materials. Theactuator 100 may be manufactured in a Good Manufacturing Process(“GMP”)-capable facility.

The actuator 100 may include a base 102 that is substantially flat(although various amendments or appendages may be added to the base 102in order to improve the actuator's gripping and/or bendingcapabilities). The base 102 may form a gripping surface that grasps atarget object.

The actuator 100 may include one or more accordion extensions 104. Theaccordion extensions 104 allow the actuator 100 to bend or flex wheninflated or deflated, and help to define the shape of the actuator 100when in an inflated or deflated state. The accordion extensions 104include a series of ridges 106 and troughs 108. The size of theaccordion extensions 104 and the placement of the ridges 106 and troughs108 can be varied to obtain different shapes or extension profiles.

Although the exemplary actuator of FIGS. 1A-1D is depicted in a “C” oroval shape when deployed, one of ordinary skill in the art willrecognize that the present invention is not so limited. By changing theshape of the body of the actuator 100, or the size, position, orconfiguration of the accordion extensions 104, different sizes, shapes,and configurations may be achieved. Moreover, varying the amount ofinflation fluid provided to the actuator 100 allows the actuator 100 totake on one or more intermediate sizes or shapes between the un-inflatedstate and the inflated state. Thus, an individual actuator 100 can bescalable in size and shape by varying inflation amount, and an actuatorcan be further scalable in size and shape by replacing one actuator 100with another actuator 100 having a different size, shape, orconfiguration.

The actuator 100 extends from a proximal end 112 to a distal end 110.The proximal end 112 connects to an interface 114. The interface 114allows the actuator 100 to be releasably coupled to other parts. Theinterface 114 may be made of a food- or medically-safe material, such aspolyethylene, polypropylene, polycarbonate, polyetheretherketone,acrylonitrile-butadiene-styrene (“ABS”), or acetal homopolymer. Theinterface 114 may be releasably coupled to one or both of the actuator100 and the flexible tubing 118. The interface 114 may have a port forconnecting to the actuator 100. Different interfaces 114 may havedifferent sizes, numbers, or configurations of actuator ports, in orderto accommodate larger or smaller actuators, different numbers ofactuators, or actuators in different configurations.

The actuator 100 may be inflated with an inflation fluid supplied froman inflation device 120 through a fluidic connection such as flexibletubing 118. The interface 114 may include or may be attached to a valve116 for allowing fluid to enter the actuator 100 but preventing thefluid from exiting the actuator (unless the valve is opened). Theflexible tubing 118 may also or alternatively attach to an inflatorvalve 124 at the inflation device 120 for regulating the supply ofinflation fluid at the location of the inflation device 120.

The flexible tubing 118 may also include an actuator connectioninterface 122 for releasably connecting to the interface 114 at one endand the inflation device 120 at the other end. By separating the twoparts of the actuator connection interface 122, different inflationdevices 120 may be connected to different interfaces 114 and/oractuators 100.

The inflation fluid may be, for example, air or saline. In the case ofair, the inflation device 120 may include a hand-operated bulb orbellows for supplying ambient air. In the case of saline, the inflationdevice 120 may include a syringe or other appropriate fluid deliverysystem. Alternatively or in addition, the inflation device 120 mayinclude a compressor or pump for supplying the inflation fluid.

The inflation device 120 may include a fluid supply 126 for supplying aninflation fluid. For example, the fluid supply 126 may be a reservoirfor storing compressed air, liquefied or compressed carbon dioxide,liquefied or compressed nitrogen or saline, or may be a vent forsupplying ambient air to the flexible tubing 118.

The inflation device 120 further includes a fluid delivery device 128,such as a pump or compressor, for supplying inflation fluid from thefluid supply 126 to the actuator 100 through the flexible tubing 118.The fluid delivery device 128 may be capable of supplying fluid to theactuator 100 or withdrawing the fluid from the actuator 100. The fluiddelivery device 128 may be powered by electricity. To supply theelectricity, the inflation device 120 may include a power supply 130,such as a battery or an interface to an electrical outlet.

The power supply 130 may also supply power to a control device 132. Thecontrol device 132 may allow a user to control the inflation ordeflation of the actuator, e.g. through one or more actuation buttons134 (or alternative devices, such as a switch, an interface, a touchdisplay, etc.). The control device 132 may include a controller 136 forsending a control signal to the fluid delivery device 128 to cause thefluid delivery device 128 to supply inflation fluid to, or withdrawinflation fluid from, the actuator 100.

Soft robotic actuators may be useful in many instances where a hardactuator is undesirable. For example, and without limitation, a softactuator may pick up a packaging blank or preform and provide it to ablow molder, after which the blow molder may reshape the blank into thedesired form based on the mold. After being shaped, the molded part willtypically be quite hot and deformable. The molded part may be retrievedby the soft actuator without damaging or deforming the molded part. Theactuator may then hold the molded part while it is being washed,labeled, filled, and/or capped. Other soft actuators may hold liveanimals gently, such as for inoculation, analysis or surgery.

One problem in conventional blow molding operations is that the objectbeing grasped has a different shape before and after blow molding(transitioning from the packaging blank to the finally-formed product.Whereas a hard gripper may have difficulty adapting to the changingshape (thus perhaps requiring two different types of grippers for asingle blow molding operation, a soft actuator may be sufficientlyadaptable to grasp both object shapes using the same gripper.

Soft robotic actuators may be inflated with a predetermined amount ofinflation fluid (or to a predetermined pressure), and the inflow/outflowof the actuators and/or the internal pressure of the actuator may bemeasured. Upon making contact with an object, the actuator may bedeflected and, as a result, inflation fluid may flow out of (or into)the actuator. This flow of inflation fluid may serve as a detector thatindicates the presence of an object at a position or generally incontact with the actuator. Alternatively, the actuator may include touchsensors, bending sensors, or other types of detection devices forregistering contact with an object.

FIG. 1E depicts a soft robotic actuator 100 with multiple fingers, inwhich the gripper hub 202 is attached to a robot arm RA, in which thefluid supply for actuation is provided via an external fluid line 118.The fingers 100 are shown in a reverse curled position and curled in thedirection 604.

FIGS. 1F and 1G depict a soft robotic actuator finger 100 that may beused with any embodiment discussed herein. Each finger 100 or actuator100 includes an elastomeric outer surface 3005 surrounding an internalvoid 3004, and the is configured to curl when an inflation fluid issupplied to the internal void 3004. A strain-limiting side 2003 resistsextension while the expanding side 3001 includes bellows features topromote extension as well as contraction upon a change in fluidpressure, either extension or contraction causing curling in onedirection or another. Reinforcing ribs 3003 constrain expansion andcontraction to occur primarily along the curling direction, and alsoprovide some texture or ridges for grasping.

FIGS. 1A-1G depict a particular type of soft robotic actuator, sometimesreferred to as an accordion-type soft actuator. However, numerous othertypes of soft actuators exist, some of which are described in connectionwith particular embodiments below. Soft actuators include actuatorsformed partially or entirely from soft or compliant materials, and mayincorporate or surround more conventional hard actuator materials.

Soft actuators may move in a variety of ways. For example, softactuators may bend, as shown above, or may twist, as in the example ofthe soft tentacle actuator described in U.S. patent application Ser. No.14/480,106, entitled “Flexible Robotic Actuators” and filed on Sep. 8,2014. In another example, soft actuators may be linear actuators, asdescribed in U.S. patent application Ser. No. 14/801,961, entitled “SoftActuators and Soft Actuating Devices” and filed on Jul. 17, 2015. Stillfurther, soft actuators may be formed of sheet materials, as in U.S.patent application Ser. No. 14/329,506, entitled “Flexible RoboticActuators” and filed on Jul. 11, 2014. In yet another example, softactuators may be made up of composites with embedded fiber structures toform complex shapes, as in U.S. patent application Ser. No. 14/467,758,entitled “Apparatus, System, and Method for Providing Fabric ElastomerComposites as Pneumatic Actuators” and filed on Aug. 25, 2014.

One of ordinary skill in the art will recognize that otherconfigurations and designs of soft actuators are also possible and maybe employed with exemplary embodiments described herein.

End Effectors

An end effector may be the device at the end of a robotic arm, designedto interact with the environment, and/or may be the last link (orendpoint) of the robot. At an endpoint, tools may be attached; or, theend effector may itself act as a tool. An end effector may include oneor both of a gripper or a tool. While grippers tend to hold, lift,transport and/or manipulate objects, tool functions often have acontrasting function, and may change a characteristic of the work objectrather than gripping or holding it. Tool functions may include weldingor fusing, spraying, dispensing, milling, screw or nut driving,flattening, cutting, and combinations of these.

At least four categories of end effector include impactive (e.g., jaws,claws, grasping a work object by direct impact, including holdingfriction); ingressive (e.g., penetrating the work object with needles,pins, or hackles); astrictive (e.g., essentially attractive or fieldforces such as Bernouilli lift, suction force, vacuum force, magnetic,electrostatic, van der Waals', ultrasonic standing waves, lasertweezing), and contigutive (e.g., essentially adhesive forces viacapillary action, glue, surface tension, freezing, chemical reaction).

In hard robotics, gripping may performed by using a form-followingstatic shape in the gripping surface (e.g., a concave cup to lift around object), or by friction force increased by closing hard fingers,jaws or claws. A soft robotic end effector may include gripperfunctionality, and may also or alternatively include some toolfunctionality. Soft robotic grippers may be impactive, and mayadditionally be made ingressive, astrictive, and/or contigutive via aparticular gripper/actuation morphology or configuration, or by addingan accessory tool within or along or opposite the soft robotic gripper.

A soft robotic gripper may include one or more soft robotic members,which may take organic prehensile roles of finger, arm, tail, or trunk,depending on the length and actuation approach. In the case of inflatingand/or deflating soft robotic members, two or more members may extendfrom a hub, and the hub may include a manifold for distributing fluid(gas or liquid) to the gripper members and/or a plenum for stabilizingfluid pressure to the manifold and/or gripper members. The members maybe arranged like a hand, such that the soft robotic members act, whencurled, as digits facing, a “palm” against which objects are held by thedigits; and/or the members may also be arranged like an cephalopod, suchthat the soft robotic members act as arms surrounding an additionalcentral hub actuator (suction, gripping, or the like). Generally,although not exclusively, as used herein, the terms “base plate”, “palmplate”, “bumper plate”, or “hub plate” may refer to a reference surfaceadjacent two or more soft robotic members against which the soft roboticmember may hold a work object, e.g., when curled in a “closing”direction, and from which the grip of the soft robotic members on thework object may be released, e.g., when the soft robotic members arecurled or recurled in an “opening” direction. The use of “plate” doesnot suggest that the member is fully planar—“plates”, unless otherwisedescribed, may have surface relief, contour, curves, peaks and valleys,texture, or the like—a “plate”, unless otherwise described, describes amember fitting within a plate-like envelope or aspect ratio.

Soft robotic gripper members may be formed of elastomeric materials,such as rubber, and/or thin walls of plastic arranged in an accordionstructure that is configured to unfold, stretch, and/or bend underpressure, or other suitable relatively soft materials. Soft roboticgripper members may include a channel and/or hollow interior that can befilled with a fluid, such as air, water, or saline to pressurize,inflate, and/or actuate the gripper member. Upon actuation, the shape orprofile of the gripper member changes by, e.g., variably curving,curling, including in opposing directions, or straightening.Alternatively or in addition, the gripper member may be actuated using avacuum to remove inflation fluid from the gripper member and therebychange the degree to which the gripper member bends, twists, and/orextends.

Actuation may also allow the gripper member(s) to exert a force on aworkpiece, such as a workpiece being grasped or pushed, as well aspartially or fully conforming to the shape of the workpiece beinggrasped. Soft robotic gripper members can also harmlessly deflect uponcollision with workpieces or the work environment.

Exemplary End-of-Arm-Tools

Exemplary embodiments described herein relate to end-of-arm tools(EOATs) having various adjustable components that allow them to grasptargets of different sizes, shapes, or properties. Some embodimentsincorporate dual gripping modes, in which a target may be grasped (usingthe same EOAT) by a hard actuator or a soft actuator, depending on theparticular application.

For example, FIGS. 2 and 3A-3B depict an exemplary EOAT 202 according toone embodiment. The EOAT 202 includes two soft actuators 100 (althoughthe present invention is not limited to use with two actuators 100),each mounted to a jaw 204 that is connected to a mechanical actuator 206inside of a hub of the EOAT 202.

The mechanical actuator 206 may include a motor, rails and a gearedmechanism that mates with corresponding gears of the motor. When themotor is driven in one direction, the motion of the gears may cause thegeared rails to move apart, pushing the jaws 204 away from each other(see, e.g., FIG. 3A, in which the jaws 204 are separated from each otherby a first distance d₁). When the motor is driven in a differentdirection, the motion of the gears may cause the geared rails to movecloser together, pulling the jaws 204 together (see, e.g., FIG. 3B,wherein the jaws 204 have been driven together by the actuator 206 sothat they are positioned at a second distance d2 smaller than the firstdistance d₁).

In another embodiment, each jaw 204 may be connected to a separatemechanical actuator, so that the jaws 204 may be adjusted independently.In either embodiment, the jaws 204 may be configured to move in the samedirection upon motion of the mechanical actuator 206 (e.g., moving bothjaws 204 to the left or to the right in FIG. 2 by the same amount).Still further, the jaws 204 may be configured to move in the same ordifferent directions, but to a different degree (e.g., with one jaw 204moving more than the other, or one jaw 204 moving while the otherremains still).

The actuator 206 is not limited to using a motor and rails, but may beactuated by any suitable technique. For example, in one embodiment apneumatic system, such as a pneumatic linear actuator, is operable toreceive a pneumatic fluid, such as air, in order to drive apart the hubsjaws 204 as they hubs are guided along the guide rails, or to eject thefluid in order to drive the jaws 204 together as they are guided alongthe guide rails. A pneumatic fluid supply tube may deliver the pneumaticfluid to or from the actuator 206. It is noted that different valvingsystems can be used to control motion of the pneumatic system.Alternatively or in addition to a pneumatic system, the gripper may behydraulically adjustable via a hydraulic fluid.

The EOAT 202 may optionally include inner grip pads 208 which serve as asecondary gripping surface. The inner grip pads 208 may have differentproperties as compared to the actuators 100, such as being lesscompliant than the actuators 100, presenting a different surface texturethan the actuators 100, having different surface properties as comparedto the actuators 100, etc. The inner grip pads may be mounted to amounting surface 306 of the jaw 204 (see FIG. 3A). The inner grip pads208 are discussed in more detail in connection with FIGS. 4A-4B.

In some embodiments, the EOAT 202 may be provided with a sensor package302, which may include (for example) a range finding sensor such as aLIDAR and/or a camera. The sensor package 302 may be used toautomatically or, under the control of a human operator, guide the EOAT202 to a grasp target and effect a grip on the target. The sensorpackage 302 may also be used to judge the size of, and distance to, atarget object, thus allowing the jaws 204 to be adjusted to anappropriate separation distance depending on the width of the object tobe grasped.

There are many scenarios where a suction cup gripper may be adept atremoving objects from closely packed environments. A suction cup 304 mayserve to provide improved grasping capability, better securing a targetobject held by one or more actuators 100.

In some instances the grip that the suction cup 304 obtains may not bestrong enough to retain the object as the gripper is reoriented orrapidly accelerated or decelerated by a robot. In these instances, itmay be useful to use a suction cup 304 to initially remove the objectfrom a closely packed environment, and then further grip as well ascradle the object with soft actuators 100 which will secure the objectas the gripper is reoriented or rapidly accelerated or decelerated.

The suction cup 304 and the actuators 100 may be mounted to a gripperhub. In some embodiments, a distal end of the suction cup 304 may beextensible to extend beyond the distal end(s) of the actuators 100.Accordingly, when the gripper is lowered over a target object to begrasped, the suction cup 304 makes initial contact with the targetobject.

Optionally, the gripper hub may be capable of applying a vacuum to thesuction cup 304 in order to engage the suction cup 304 (causing thesuction cup 304 to withdraw towards the gripper hub, as described inmore detail in connection with FIGS. 17-18). More specifically, as longas an opening at the end of the suction cup 304 is blocked (e.g., by thegrasp target), the suction applied to the cup 304 has the effect ofcollapsing one or more accordion folds of the cup 304. In addition, thisforce may be used to retract the suction cup, as described in moredetail below.

Once the target object is pulled clear of other objects in theenvironment, the actuators 100 may be actuated in order to grasp andfurther secure the target object.

In some embodiments, the suction cup 304 does not substantially changelength upon applying vacuum. In these cases, the actuators 100 may bereverse curled so that they do not interfere with the suction cup's 304ability to contact the object and gain an initial grasp. After theobject has been grasped and pulled away from its cluttered environmentby the suction cup 304, the vacuum in the soft actuators 100 may bereplaced by positive pressure in order to allow the soft actuators 100to apply a gripping force to the grasp target.

FIGS. 4A-4B depict an exemplary use of the inner grip pads 208. In theseexamples, the EOAT is first called upon to grasp a relatively small,compliant object 402, and then a relatively large, rigid object 404.

When grasping the compliant object 402, the actuators 100 are firstmoved to an appropriate distance via action of the mechanical actuatorand are moved into a grasping position by moving the EOAT over thetarget object 402. Then, the actuators 100 are actuated in order tosecure a grasp on the target object 402.

However, it may be difficult for the soft actuators 100 to pick up largeor heavy objects. Moreover, while the actuators 100 are adept at pickingup soft or compliant objects without damaging them, this may not be aconcern for rigid or hard objects, such as the object 404. In this case(see FIG. 4B), the EOAT may be lowered further over the object 404 inorder to place a portion of the object 404 within the range of the innergrip pads 208. Because the inner grip pads are less compliant (e.g., aremore rigid) than the actuators 100, the inner grip pads 208 may be ableto secure a stronger grip on the object 404. To this end, the inner grippads 208, which are attached to the jaws 204, may be moved throughaction of the mechanical actuator 206 to close around the portion of theobject 404. This exemplary technique is particularly useful for graspingheavy rigid objects, such as bottles, cans, high density objects,metallic objects, etc.

As can be seen by comparing FIG. 4A to FIG. 4B, the presence of theinner grip pads 208 allows a single EOAT to make use of two differentgripping modes, one for hard objects and one for soft or easily damagedobjects.

Another way to enable multiple gripping modes is through the use of thesoft actuators 100. In a normal gripping mode, the actuators 100 areinflated in order to cause them to curl and grasp an object (as shown inFIG. 4A). However, another option is to maintain the actuators in astraight, neutral state (i.e., neither positively inflated so as tocause the actuators 100 to curl, nor negatively inflated so as to causethe actuators 100 to reverse curl). In this state, the mechanicalactuator 206 can move the jaws 204 towards each other to secure a targetobject 406, 408 between the actuators, as shown in FIGS. 4C and 4D. Asshown in these examples, this technique may be used to grasp bothrelatively large objects 406 and relatively small objects 408 with thesame EOAT.

This may result in a better grasp, as compared to curling the actuators100, when it is important to present a larger gripping surface (due tothe actuators 100 remaining in a straight, rather than curled,configuration). For instance, if the gripping surface on the insidewalls of the actuators 100 is textured to promote a stronger grip, itmay be helpful to expose more of this textured surface to the targetobject 406, 408 than would be possible if the actuators 100 were curled.

This technique can also be used when the actuators are positivelyinflated in order to adjust or maintain grip force control. For example,if the EOAT detects that the grasp on the target object is loosening,the EOAT could supply additional inflation fluid to the actuators 100,but could also or alternatively move the jaws 204 closer together.Similarly, if it appears that an object is being held too rigidly (e.g.,it appears as though it might become damaged), the EOAT can deflate theactuators 100 and/or move the jaws 204 further apart.

The presence of the mechanical actuator 206 also allows for other typesof unique control schemes. For example, FIGS. 5A-5B depict an embodimentin which the distance between the jaws 204 is adjusted to maintain anoptimized grip on a target object 502.

In FIG. 5A, the actuators 100 are reverse-curled so as to move them outof the way of the target object 502. Upon moving into a suitableposition over the target object, the actuators 100 are neutrallyinflated so as to remain in a straight configuration (FIG. 5B). In thisstate, the actuators 100 exert a force F_(a) on the target object, whichresults in an opposing outward force F_(a) on the jaws 204.Simultaneously, the actuator 206 may be configured to maintain an inwardforce F_(j) on the jaws 204. As the actuators 100 are inflated moresubstantially in order to maintain a stronger grip on the target object502, the jaws 204 are pushed further apart and the actuator 206 counterswith a stronger force F_(j) (and vice versa). A controller may attemptto maintain the force F_(j) such that F_(j)≥F_(a). Accordingly, the EOATprovides a self-leveling or self-optimizing grip on the object 502 asequilibrium is reached between the jaw spacing and the actuator 100 gripposture on the object 502.

FIG. 6 provides an overview of the different ways in which variouscomponents of the EOAT can move. As shown by the arrows 602-1, 602-2,each of the jaws 204 are capable of independent or dependent movementlaterally with respect to the EOAT (e.g., left-to-right in FIG. 6, orperpendicular to a direction in which the actuators 100 extend when in aneutral configuration). The actuators are capable of moving in acircumferential direction 604-1, 604-2 with respect to the EOAT.Furthermore, the suction cup 304 is capable of moving in a longitudinaldirection 606 perpendicular to the lateral direction and parallel to thedirection of extension of the actuators 100 when in a neutralconfiguration.

FIG. 7 provides a bottom view of the EOAT, in which the sensor package302 is visible; FIGS. 8 and 9 show the same EOAT in a perspective view(FIG. 8 depicts the EOAT with the actuators 100 in a wide configuration,while FIG. 9 depicts the EOAT with the actuators 100 in a narrowconfiguration).

In this example, the sensor package 302 includes a range finger 706 anda camera 704, although one of ordinary skill in the art will recognizethat other sensors may also be used. The sensors are configured to beequidistant from the actuators 100 so as to allow for better positioningof the EOAT over the target object.

The camera 704 may be used to estimate a width of the target object,and/or may be used to estimate surface properties or characteristics ofthe target object (e.g., whether the target object is likely to beslippery or is textured, whether the target object is compliant orrigid, whether the target object is fragile, etc.). Other sensors mayalso be used for this purpose. In some cases, the camera 704 may be usedto perform object recognition, and the EOAT may receive signals from acontroller that maintains a database of objects against which the camerasignals may be matched. Depending on which object in the database ismapped to the object currently being viewed by the camera, thecontroller may provide the EOAT with information pertaining to thetarget. In some embodiments, based on the object recognition, the EOATmay select a suitable grasping mode (e.g., using the inner gripper pads208, using the actuators 100 in a straight, neutral configuration withassistance from the jaws 204, inflating the actuators 100, or somecombination of these techniques).

The range finder 706 may be used to estimate a distance to the targetobject, so that the EOAT can be lowered to engage a target portion ofthe target object according to the grasping mode selected. For example,if the grasping mode involves use of the inner gripper pads 208, theEOAT may be lowered so that a target portion of the target object willbe engaged by the inner gripper pads 208, instead of by the actuators100. On the other hand, if the actuators are to be used, the EOAT may belowered so that the target object will be contacted by the actuators 100without interference by the inner gripper pads 208.

As shown in FIG. 9, the sensor package 302 is sized and positioned sothat the actuators 100 and/or inner gripper pads 208 will not interferewith the sensor package when the jaws 204 are moved together into theirclosest configuration.

In some embodiments (as shown for example in FIGS. 10-12), the suctioncup 304 may be attached to a retractable rod controllable through anactuator 1002. In these cases, the suction cup 304 may be extendedtowards a grasp target by action of the rod by the actuator 1002. Thesuction cup 304 may seal with the grasp target, at which point the rodmay be retracted back towards the gripper hub using the actuator 1002thus drawing the grasp target back towards the actuators 100 attached tothe gripper hub. The actuators 100 may then be actuated in order to holdand cradle the grasp target.

FIGS. 13-16 are cross-sectional views showing the internal structures ofthe EOAT. For instance, FIG. 13 depicts the internal rail 1302 used tomove the jaws 204 via the actuator 206. In the depicted embodiments,motion of the EOAT and actuation of the various actuators 100, 206, 1002may be governed by an EOAT controller 1304. The EOAT controller 1304 mayreceive and process signals from various sensor controllers, such as arange finder controller 1306 and a camera controller 1308. The EOATcontroller 1304 may, for example, perform the procedure depicted in FIG.19.

As previously noted, an inflation fluid may be provided to an internalvoid of the actuators 100. FIG. 15 depicts an exemplary movable fluidpassage 1502 for the soft actuators 100. In operation, fluid may beprovided from an inflation fluid supply line connected to the EOAT,routed through the EOAT to the movable fluid passage 1502, and fromthere into the internal void of the actuator 100 (and vice versa). Themovable fluid passage 1502 may be configured to move with the jaws 204so that fluid can be delivered to the actuators 100 regardless of theconfiguration of the jaws 204.

FIG. 17 depicts a technique for retracting the suction cup 304. In thisexample, the air pressure or force used to push the suction cup 304 toan extended position via the actuator 1002 may be regulated to providean optimized force value (in a similar manner to that described inconnection with FIG. 5B). In this case, the system may balance thedownward force applied to extend the suction cup 304 with the upwardforce exerted on the suction cup 304 by the target object 502. Thus, theactuator 1002 may be back-driven by contact with the object 502 so thatthe suction cup 304 automatically retracts as the EOAT is loweredtowards the object 502.

Another retraction technique is depicted in FIG. 18. In this example,the suction cup 304 is attached to a manifold bar 1802, and a vacuum isapplied through the manifold bar 1802 by suctioning fluid throughpneumatic tubing. The pneumatic tubing is pinned inside of a cover 1804of the EOAT at a location 1806. The pneumatic tubing and cover 1804 haveseveral properties that allow the tubing to self-retract into the cover1804 in this configuration. First, an outer surface of the pneumatictubing has a relatively low coefficient of friction (COF). Second, thetubing has sufficient stiffness so that it can act as a spring.Furthermore, the cover 1804 has a particular constraining shape so thatthe spring-like tubing, when secured at the location 1806, attempts totake on a larger curved radius than the cover 1804 constrains it thetubing be in. This causes the tubing to be pushed up into the cover1804, which is facilitated by the low COF of the tubing surface.

Grasping Method

FIG. 19 describes a procedure for deploying and using an end effector asdescribed above. In FIG. 19, blocks surrounded by dashed lines representoptional steps to be used when a suction cup is to be employed. Blockssurrounded by dashed-and-dotted lines represent optional steps to beused when the gripping mode relying on the soft actuators (rather thanthe inner grip pads) are employed.

At block 1902, a robotic end effector may be provided and affixed to arobotic system (e.g., a robotic arm). The robotic end effector may be arobotic end effector as depicted and described herein.

At block 1904, the system may judge characteristics of a target objectto be grasped. These characteristics may include: the distance to thetarget object; the size, shape, or configuration of the target object; atype of the target object (as detected, e.g., by object recognition asdescribed above); properties of the target object (as received, e.g.,from an object library or database as described above; etc.

At block 1906, the system may select a grasp mode for the target objectbased on the characteristics identified in block 1904. Grasp modes mayinclude, for instance, a first grasp mode employing inner grip pads.Such a grasp mode may be used if the object is determined to berelatively hard, rigid, or heavy. Another grasp mode may include aneutral actuation grasp mode, in which the actuators are maintained in astraight configuration and pushed into the target object through actionof the jaws. This grasp mode may be selected if the size, shape,configuration, and/or properties of the target object suggest that moregripping surface would be beneficial in securing a strong grasp of thetarget. Yet another grasp mode may include positive actuation of theactuators, with or without action of the jaws. This grasp mode may beselected if the target object is determined to be relatively compliantor fragile, or if the size, shape, or configuration of the objectindicate that it would be difficult to grasp with the inner grip pads.

At block 1908, the EOAT may be moved into proximity with the targetobject. In some embodiments, this may involve making contact with thetarget object, while in others the EOAT may be moved to within apredetermined distance of the target object. The distance selected maybe dependent upon the grasp mode selected in block 1906. The movement ofthe EOAT may be guided by various sensors, such as proximity sensors,cameras, touch sensors, etc. In some embodiments, the EOAT may bepositioned in this block so as to be relatively centered over an axis ofthe target object. The axis of the target object may represent agrasping axis along which the actuators may be arrayed (e.g., along along axis of the bumper plate when the object is grasped).

At block 1910, the jaws and/or actuators may be moved into an initialposition, which may be dependent upon the grasp mode selected at block1906. For example, the jaws may be moved to an initial position thatpositions the inner grip pads and/or actuators at a sufficient distanceapart that they will not interfere with the target object as the EOAT ismoved into position. In some embodiments, this may involve applying avacuum to reverse-inflate the actuators 100 in order to move them out ofthe way. In some embodiments, the jaws may be moved to a lesser degreethan they otherwise would have based on a determination (e.g., from thecamera in the EOAT's sensor package) that the target object is in acrowded environment. If a controller determines that a portion of theEOAT would be interfered with by an object in the environment, thecontroller may order the jaws to a more narrow position than would haveotherwise been called for. In some embodiments, the position of the jawsand/or the inflation status of the actuators 100 may be manipulated asthe EOAT moves through the environment (e.g., narrowing a profile of theEOAT to fit into a relatively tight space before extending the jawsand/or actuators).

At block 1912, the system may optionally deploy a suction cup. Thesuction cup may be lowered by a suction cup actuator into proximity witha target object. At block 1914, the suction cup may be pushed into thetarget, which may optionally cause the suction cup actuator to begin toretract as described in connection with FIG. 17.

At block 1916, the jaws may be moved into a final grasping position. Thefinal grasping position may be a position of the jaws as the targetobject is grasped, and may depend on the grasp mode selected in block1906. For instance, if the inner gripper pads are used to grasp theobject, the jaws may be moved to push the inner gripper pads into thetarget object to secure a grip on the target object. If the actuators100 are to be used, the jaws may be moved into position to allow thedistal tip (or as much of the gripping surface of the actuators aspossible) to be pressed into a target portion of the target object, uponactuation of the actuators (which may be performed in block 1918, ifappropriate to the selected grasp mode).

Blocks 1916 and 1918 may be carried out individually or together. Forexample, the action of the jaws may balance the action of the actuatorsas both exert a force on the target object, as described in connectionwith FIG. 5B.

At block 1920, the suction cup may optionally be retracted. In someembodiments, the retraction may be performed automatically, as shown inFIG. 18.

Having thus secured the target object in the grip of the EOAT, at block1922 the EOAT may be translated and/or rotated to move the target objectto a desired destination or configuration.

The above-described method may be embodied as instructions or logicstored on a non-transitory computer-readable medium. When executed, theinstructions or logic may cause a processor circuit to perform theabove-described method using a robotic system.

Additional Detail

With respect to the above description, as shown in FIGS. 15 and 21Athrough 21C, the soft robotic grasping system may apply fluid pressureto the fingers 100 in any position of the jaws 204 in order to grasp anarticle (402, 404, 406, 408, 502). The gripper hub 202 provides routingfor the finger actuator 120 (such as inflation device 120), and thefinger actuator applies a pressure change—typically fluid pressure (gasor liquid), and changing among positive, neutral, and negative gaugepressure. The routing directs pressure (equally, distributed, orcontrolled) to the p soft robotic fingers 100. Each soft robotic finger100 includes the elastomeric outer surface 3005 surrounding the internalvoid 3004, and is configured to curl in a first degree of freedom(corresponding to a direction of arrows 604 in FIG. 6) when the fingeractuator 120 applies the pressure change within the internal voids 3004.A plurality of linkages, such as the base members supported by the rails1302, support and move the fingers 100, and may include another actingmember such as jaws 204. As described herein, the linkage is one or moremoving connections between the hub and the fingers. One example would bea linear actuator, in which the supporting member and rail 1302 togetherinclude a linear motor, electrically driven to form actuator 206. Otherexamples of linkages would be a rack and pinion, screw or ball screw,four-bar linkage, cam, and/or gear train, each driven by a motor orfluid power to form actuator 206. In this case, each linkagerespectively connects a soft robotic finger 100 to the hub 202, and isconfigured to guide in a second degree of freedom (corresponding to thetranslation direction arrows 602 in FIG. 6, or the pivoting directionarrows 2402 in FIGS. 24A and 24B) to change a pose of the connected softrobotic finger 100 relative to the hub 202. The second degree of freedomneed not be a simple translation or rotation, but may be guided along apath by a cam, swing arm, groove or the like. The linkage actuators suchas the electric or fluid power drives are connected to the linkages andcause the linkages to move.

As shown in a front view in FIG. 20A, each gripper hub 202 may have softrobotic fingers 100 connected to the hub 202 via linkages (hereincluding moving members 204 and rails 1302, and driven as actuators206). Along a center axis CA region, a camera 704 and/or a vacuum cup304 may be arranged. The vacuum cup 304 may be extendible via anextension arm 304 (which may be a guided rod, a scissor linkage, orother extending linkage). As shown in FIG. 20B, in a side view of thegripper hub 202, the camera 704 may be placed in the center along thegripper direction, between the two fingers 100, with the vacuum cup 304and extension actuator 309 offset from the center axis CA to the side.Alternatively, as shown in FIG. 20C, in a side view of an alternativegripper hub 202, the vacuum cup 304 and extension actuator 309 mayoccupy the line along the gripper direction, with a camera 704 offsetfrom the center axis CA to the side (or, as shown, two cameras 704offset similarly).

As shown in FIGS. 15 and 21A through 21C, each soft robotic finger isconnected to a fluid passage tube 1502 for providing fluid to the softrobotic fingers 100. The fluid passage tubes are formed to moveaccording to the linkages (when the linkages are caused to move), andare configured to provide the pressure change to the internal voids 3004in any position reached by any soft robotic finger 100, even accordingthe first and second degrees of freedom. For example, FIG. 21A shows thelinkages arranged with the fingers 100 in an ungrasped, reverse curledposition (e.g., corresponding to negative gauge pressure), and alsoclosest together (potentially applying a clamping force in the directionof arrows 602), while FIGS. 21B and 21C show the linkages arranged withthe fingers 100 in respective neutral and curled grasping positions(e.g., respectively corresponding to neutral and positive gaugepressure), and also farthest apart in the direction of arrows 602.

As shown in FIGS. 22A and 22B, fluid may be routed from the inflationdevice 120 via the hub 202 treating the hub 202 as a distributingmanifold. In this case, the hub is sealed with respect to the fluidpressure via hub seal 202A, and each linkage is sealed with respect tothe fluid pressure via linkage seals 1302A (for example, applied viarails 1302). In this case, the seals 1302A are linkage fluid seals 1302Aabout the linkages, and the linkage fluid seals 1302A permit thelinkages to move while sealing fluid flow to the fluid passage tubes1502. The hub seal 202A includes a fluid seal about the hub 202retaining interior fluid pressure, and the finger actuator 120 appliesthe pressure change to the interior of the hub 202, and the pressurechange is transmitted, contained by the linkage fluid seals 1302A andhub seal 202A, via the fluid passage tubes 1502 to the soft roboticfingers 100.

FIG. 22B depicts a more complete system, where the gripper hub 202,together with its fluid routing, camera, vacuum cup, linkages, and theirrespective actuators (as detailed herein) is mounted to a robot arm RA,which may be a 3-7 (or more) axis robot arm extending from a base RABASE. The 3-7 axes are additional degrees of freedom for the gripper hub202 and soft robotic fingers 100 as discussed herein. As shown, althoughsome actuators and circuit boards may be positioned within the gripperhub itself, the soft robotic gripper system may also include actuators,circuit boards, fluid and vacuum supplies, and motor drivers and othercomponents away from the gripper hub 202 (e.g., in a cabinet or controlpanel adjacent the robot arm RA). FIGS. 22A and 22B show local andremote routing of fluids, vacuum, sensing, and control to a controller136, a fluid delivery device 128 (and/or independent second fluiddelivery device 128 a), a pressure transducer 129 detecting a fluidpressure to the fingers 100, a suction actuator 305 (such as a vacuumsource), a pressure transduce 303 detecting a fluid pressure in thesuction actuator 305, a driving motor 207 and/or motor driver 207 a fordriving the linkages to translate or rotate the fingers 100 (the drivingmotor and/or driver 207 a may be electric, and/or fluid power, e.g.,hydraulic or pneumatic, and may be located within, adjacent to, orremote from the gripper hub 202).

As described herein, and as shown in FIGS. 21A-21C and 22A-22B, asuction actuator 305, such as a vacuum source, applies a second pressurechange, which is routed to the suction cup 304 in any extension positionof the suction cup 304 and is configured to apply a suction forceaccording to the second pressure change. Accordingly, the suction cup304 has an additional fluid passage tube 307, which is also movable andsealed while moving. An extension linkage, such as the rod, rail, andoptionally linear motor forming actuator 1002 (e.g., as shown in FIGS.10-12) connects the suction cup 304 and the gripper hub 202, theextension linkage 309 being configured to extend and retract to change apose of the suction cup to the hub.

The controller 136, 1304 may be configured to activate the suction cup304 and extension actuator 309 to cause the suction 304 cup to contactthe article (e.g., article 402, 404, 406, 408, or 502), lift the articleby the suction force, and retract the article toward the gripper hub202. The controller 136, 1304 may also activate the finger actuator 120to cause the soft robotic fingers 100 to curl to apply a grasping forceto the article.

The soft robotic grasping system, including the gripper hub 202, fingers202 that curl (among curling in, neutral, and curling out) via pressurechange, and linkages (as described, one or more moving connectionsbetween the hub and the fingers) that move each finger 100 in anadditional degree of freedom, may combine the forces from the curlingfingers and the linkage actuator. In this case, the linkage actuator(s)(e.g., electric motor or fluid power moving the linkages) are configuredto cause the linkage to move while the soft robotic fingers 100 curl inwith a grasping force, and the soft robotic fingers 100 are moved tograsp according to the combined curling of the fingers 100 (and, e.g.,curling force) and first degree of freedom (and, e.g., clamping force).

As shown in FIGS. 23A-23B and 24A-24B, the first degree of freedom maybe one of one of translation or rotation. In FIG. 23A, the linkage,using the rail 1302 and actuator 206, supports the fingers 100 to movein the translation direction indicated by arrows 602 (toward and awayfrom the central axial CA region of the gripper hub 202), and thefingers 100 are shown in an inner or innermost translation position,curled outwardly, facing an article to be captured. In FIG. 23B, thefingers 100 have been translated by the linkage to an outer or outermosttranslation position, curled inwardly, holding an article. Although FIG.23A shows the curled outward position of the fingers 100 together withthe inner or innermost translation position of the fingers 100, thetranslation direction of the linkage and the curling direction of thefingers 100 are independent and may be opposite to that shown—forexample, the fingers 100 may be curled outward and in an outer oroutermost position of the linkage, and/or the fingers 100 may be curledinward and in an inner or innermost translation position of the linkage.

In FIG. 23B, the linkage, using the pivot 1305 and actuator 206,supports the fingers 100 to move in the rotation direction indicated byarrows 2402 (toward and away from the central axial CA region of thegripper hub 202), and the fingers 100 are shown in an outer rotationposition, curled outwardly, facing an article to be captured. In FIG.23B, the fingers 100 have been rotated by the linkage to an innerrotation position, curled inwardly, holding an article.

As FIG. 23A shows the curled outward position of the fingers 100together with the inner or innermost translation position of the fingers100, and FIG. 24A shows the curled outward position of the fingerstogether with an outer rotation position of the fingers 100, it can beseen the translation or rotation direction of the linkage and thecurling direction of the fingers 100 may be independent, or may belinked—for example, the fingers 100 may alternatively be curled outwardand in an outer translation position of the linkage, and/or the fingers100 may be curled outward and in an inner rotation position of thelinkage. The independent positioning of two degrees of freedom may beused to, for example, not only combine the forces of the two actuators(linkage—clamping and soft finger—curling), but also to fit the fingers100 through narrower gaps or into narrower containers, as well as openthe fingers 100 as wide as possible (translated or rotated outward andcurled outward) or close them as narrowly as possible (translated orrotated inward and curled inward).

It should be noted that although at least two symmetric fingers andcorresponding linkages (e.g., linear actuators) are shown in eachdrawing connecting fingers 100 to the hub 202, the invention herein mayuse any number of fingers 100 from a single finger 100 and/or linkage tomultiple fingers 100 and/or linkages, and may in addition oralternatively press the article (e.g., article 402, 404, 406, 408, or502), against a rigid member, side plate, spatula, or palm plate.

Again, as shown throughout, and in FIGS. 23A-23B and 24A-24B, thetranslation or rotation linkages may be joined by an astrictive effectorsuch as the suction cup 304, configured to apply an astrictive force,and extension linkage may connect the astrictive effector and thegripper hub 202, configured to extend and retract to change a pose ofthe astrictive effector relative to the hub 202. The first degree offreedom (of the linkage) may apply a clamping force, and the curling mayapply a grasping force. The controller 136, operatively connected toeach and all of the astrictive effector, the finger actuator 100 and thelinkage actuator 206, may be configured to activate the astrictiveforce, the clamping force, and the grasping force in a predeterminedorder (e.g., first the astrictive force, then the grasping force, thenthe clamping force). Alternatively, or in addition, the controller 136may be configured to maintain the grasping force and clamping force (andoptionally the suction force) in a predetermined relationship to oneanother. For this purpose, one or more feedback sensor (e.g., such aspressure transducer 129, measuring fluid pressure within the finger(s)100, and/or force or pressure transducer 303, measuring fluid pressurewithin the suction cup 304, and/or back EMF or pressure force in thelinkage actuator, as shown in FIGS. 22A and 22B) may be connected to thecontroller 136.

In some cases, as shown in FIGS. 20A-20C, 25A-25C, and 26A-26C, the hub202 may have an axial center region about an axial center CA line. Inone implementation, a camera 704 is positioned in the axial centerregion and is configured to direct the optical axis of the camera 704along the axial center line, and the astrictive effector (e.g., suctioncup 304) and extension linkage 309 are positioned adjacent the axialcenter region and configured to direct the extension of the astrictiveeffector parallel to the axial center line.

FIGS. 25A-25C and 26A-26C show bottom schematic views of gripper hubs202 equipped with different components in different combinations asdiscussed herein. FIGS. 25A-25C show a substantially bilaterallysymmetric gripper hub 202 with two fingers 100, and FIGS. 26A-26C show asubstantially trilaterally symmetric gripper hub 202 with three fingers100. Symettry and finger count may be of higher orders. As shown inFIGS. 25A-25C and 26A-26C, the gripper hub 202 may have an axial centerregion about an axial center line, a plurality of grasping directionsG-D being radially symmetric about the axial center line, and aplurality of accessory directions A-D being defined between adjacentgrasping directions G-D. The soft robotic fingers 100 may be arrangedalong the grasping directions and be configured as generally describedherein, e.g., to curl in a first degree of freedom along the graspingdirection G-D when the finger actuator applies the pressure changewithin the internal void. A first accessory acting along the axialcenter line may be positioned in the axial center region. In FIGS. 25Aand 26B, the axial center region accessory is a camera 704, while inFIGS. 25B-25C, 26A and 26C, the axial center region accessory is avacuum chuck or suction cup 304 (optionally, as discussed herein,extendable from the hub 202 along the axial center line).

A second accessory may act parallel to the axial center line CA, and maybe positioned along an accessory direction A-D adjacent the axial centerregion. In FIG. 25A, the accessory direction A-D holds an illuminator708 and a vacuum chuck or suction cup 304, and in FIG. 25B, theaccessory direction A-D holds a pair of cameras 204 bracketing thevacuum chuck or suction cup 304. In FIG. 25B, as well as in FIGS. 26Aand 26C, the pair of cameras 704 may be arranged to having overlappingFOVs and/or to provide parallax observations of the fingers 100 orsuction cup 304, and alternatively or in addition to measure distancevia binocular range finding. The overlapping FOVs, parallax observation,and binocular vision may be used in the camera recognition systems andprocesses discussed herein with reference to FIGS. 27A-27C and 28A-28C.In FIG. 25C, the accessory directions A-D are occupied by theaforementioned pair of cameras 704, as well as by an optical, IR, and/orlaser range finder 706 (e.g., time of flight, phase difference,triangulating). In FIG. 26A and FIG. 26C, the accessory directions areoccupied by the pair of cameras 704, illumination 708, and by arangefinder 706. It should be noted that the illumation 708 (e.g., anarray of LED lights) may create shadows of the article, fingers 100,and/or suction cup 304 and extension 309, one upon the other or upon theenvironment, and the shadows may be observed as the characteristicemployed in the camera recognition systems and processes discussedherein with reference to FIGS. 27A-27C and 28A-28C. In FIG. 26B, theaccessory directions A-D are occupied by a vacuum chuck or suction cup304 and by illumination 708.

Accordingly, by arranging the accessories along the accessory directionA-D, independent of and without interference of either the curlingmotion or the clamping motions in the grasping direction G-D,complementary functions including the suction cup lift and functionalobservations may be accomplished together with the primary grippingfunction. The accessories may be selected from the vacuum chuckextendible in a direction parallel to the axial center line, the camerahaving an optical axis extending in a direction parallel to the axialcenter line, the range finder having a ranging axis extending in adirection parallel to the axial center line, and the illuminationilluminating at least partially the same area as the camera observation.

With respect to the camera 704, the controller 136 may be connected tothe camera 704 and the finger actuator 120 (and/or motor driver 207 a,driving motor 207 actuating actuator 206), and configured to compare anobservation of the soft robotic fingers 100 to a reference state todetermine an ungrasped state (e.g., where the fingers 100 are neutral,idle and/or curled open), and/or an article grasping state (e.g., wherethe fingers 100 are translated, rotated, and/or curled inward and havecaptured an article) and/or an empty grasping state (e.g., where thefingers 100 are translated, rotated, and/or curled inward yet have notcaptured an article). The empty grasping state may have a recognizablevariation in a partial grasping state (where the article is not securelygrasped). One response to detecting an empty grasping state would be totry again, in which case the controller 136 may instructing the fingeractuator 120 (and/or motor driver 207 a, driving motor 207 actuatingactuator 206), to, e.g., apply pressure, to change from an emptygrasping state to an ungrasped state after the empty grasping state isdetermined.

Examples are shown in FIGS. 27A-27C, each of which depicts a side viewof one of the aforementioned states as well a field of view (FOV) fromthe perspective of a camera 704 (in this case, mounted in the centralaxis region). In FIGS. 27A-27C, neither the linkages for translating orrotating the fingers 100 nor the suction cup 304 are shown (the camerarecognition described herein may work with or without the linkage orsuction cup functions).

In FIG. 27A, the article (e.g., 402, 404, 406, 408, or 502) has not yetbeen grasped, the fingers 100 being in a curled outward position, andthe article is relatively distant from the gripper hub 202. Accordingly,within the field of view FOV, the proportion of the scene (e.g.,measured in pixels, or blocks, or area) obscured or occupied by thefingers 100 is relatively low, as is the proportion of the sceneobscured or occupied by the article. By recognizing a characteristic ofthe fingers 100 associated with the area or proportion or shape obscuredor occupied (e.g., a color using an RGB sensor or filter, a texture, orindicia), such as a low or relatively lower threshold valuecorresponding to the obscured or occupied finger 100 area, thecontroller 136 may recognize an ungrasped state.

In FIG. 27B, the article (e.g., 402, 404, 406, 408, or 502) has beengrasped, the fingers 100 being in a curled inward position, and thearticle is relatively close to the gripper hub 202. Accordingly, withinthe field of view FOV, the proportion of the scene (e.g., measured inpixels, or blocks, or area) obscured or occupied by the fingers 100 isrelatively higher, as is the proportion of the scene obscured oroccupied by the article. The article obstructs the fingers 100, reducingthe finger 100 area that may be observed. By recognizing acharacteristic of the fingers 100 associated with the area or proportionor shape obscured or occupied such as being below a high or relativelyhigher threshold value corresponding to the obscured or occupied finger100 area, the controller 136 may recognize an article grasping state.

In FIG. 27C, the article (e.g., 402, 404, 406, 408, or 502) has not beensuccessfully grasped, the fingers 100 are in a curled inward position,and the article is absent (or may be behind or obscured by the closedfingers, not shown). Accordingly, within the field of view FOV, theproportion of the scene (e.g., measured in pixels, or blocks, or area)obscured or occupied by the fingers 100 is again relatively higher. Thefinger 100 area that may be observed is higher or even a maximum. Byrecognizing a characteristic of the fingers 100 associated with the areaor proportion or shape obscured or occupied, such as being above a highor relatively higher threshold value corresponding to the fullyobservable 100 area, the controller 136 may recognize an empty graspingstate.

In each of FIGS. 27A through 27C, the gripper hub 202 has an axialcenter region about an axial center line (as also shown in FIGS. 20B and25A), and the camera 704 is positioned in the axial center region and isconfigured to direct the optical axis of the camera along the axialcenter line. The reference state may include a predetermined proportionof the field of view FOV corresponding to a recognized characteristic ofthe soft robotic fingers 100, in particular, the empty grasping state,as this is the state that most needs a “retry”.

The camera recognition of the ungrasped, article grasping, and emptygrasping states may work together with, or independently of, observingan extension state and/or a successful suction cup holding state of thesuction cup 304. For example, where an astrictive effector such as thesuction cup 304 is used to apply an astrictive force, and an extendingand retracting extension linkage 309 (extending and retracting inperpendicular direction to the grasping direction) connects theastrictive effector and the gripper hub 202, the controller 136 mayalternatively or in addition be configured to compare an observation ofthe soft robotic fingers 100 and/or extension linkage 309 to one or morereference states to determine whether the article is successfullygrasped.

In FIG. 28A, the article (e.g., 402, 404, 406, 408, or 502) has beencaptured or is about to be captured by the suction cup 304, and thearticle is relatively distant from the gripper hub 202. Accordingly,within the field of view FOV, the proportion of the scene (e.g.,measured in pixels, or blocks, or area) obscured or occupied by thesuction cup 304 and/or extension linkage 309 is relatively low, as isthe proportion of the scene obscured or occupied by the article. Byrecognizing a characteristic of the suction cup 304 and/or extensionlinkage 309 associated with the area or proportion or shape obscured oroccupied (e.g., a color using an RGB sensor or filter, a texture, orindicia), such as a low or relatively lower threshold valuecorresponding to the obscured or occupied suction cup 304 or extensionlinkage 309 area, the controller 136 may recognize a pre-capture state(and, e.g., calibrate an expected area or other characteristic accordingto the distant suction cup 304 and/or article).

In FIG. 28B, the article (e.g., 402, 404, 406, 408, or 502) has beencaptured, and the article is relatively close to the gripper hub 202.Accordingly, within the field of view FOV, the proportion of the scene(e.g., measured in pixels, or blocks, or area) obscured or occupied bythe suction cup 304, extension linkage 309 is relatively higher, as isthe proportion of the scene obscured or occupied by the article. Byrecognizing a characteristic of the suction cup 304 and/or extensionlinkage 309 associated with the area or proportion or shape obscured oroccupied such as being below a high or relatively higher threshold valuecorresponding to the obscured or occupied suction cup 304 and/orextension linkage 309 area, the controller 136 may recognize asuccessful suction capture state.

In FIG. 28C, the article (e.g., 402, 404, 406, 408, or 502) has not beensuccessfully captured, and the article is absent (or may be distant).Accordingly, within the field of view FOV, the proportion of the scene(e.g., measured in pixels, or blocks, or area) obscured or occupied bythe suction cup 304 and/or extension linkage 309 is again relativelyhigher. The suction cup 304 and/or extension linkage 309 area that maybe observed is higher or even a maximum. By recognizing a characteristicof the suction cup 304 and/or extension linkage 309 associated with thearea or proportion or shape obscured or occupied, such as being above ahigh or relatively higher threshold value corresponding to the fullyobservable area, the controller 136 may recognize a failed suctioncapture state.

In the case where the linkages connect each soft robotic finger 100 tothe gripper hub 202 and change a pose of the connected soft roboticfinger 100 relative to the hub 202, the camera 704 may be arranged tohave a field of view FOV and/or focus configured to observe the softrobotic fingers 100 in a range or plurality of poses of the connectedsoft robotic finger 100 relative to the hub 202. In the case where anextension linkage connects an astrictive effector and the hub asdescribed, the camera 704 may have a field of view FOV and/or focusconfigured to observe the soft robotic fingers 100 in any of anungrasped, article grasping, and empty grasping state, as well asobserve the extension linkage 309 in unextended and extended states.

It should be noted that the grip pads 208 of FIGS. 4A, 4B may beemployed with any of the structures of FIGS. 20-28 inclusive. In thiscase, a plurality of grip pads 208 are provided, each grip padrespectively connected to a translating member of a linkage, and eachgrip pad 208 being configured to apply a clamping force when thetranslating member is moved. As described, the linkage actuators 206,driving motor, or motor driver 207 a may be configured to cause thelinkages to move. The controller 136 may be configured to, in a firstmode, activate the linkage actuators (e.g., 205, 207, 207 a) to causethe translating members of the linkages to move to apply the clampingforce to a first article (e.g., article 404), and in a second mode,activate the finger actuator 120 to cause the soft robotic fingers 100to curl to apply a grasping force to a second article (e.g., article402, 406, and/or 408). This is generally shown in FIGS. 4A, 4B.

In this case, in a third mode, the controller 136 may activate thefinger actuator 120 to cause the soft robotic fingers 100 to curl toapply the grasping force to the second article 404 and activate thelinkage actuators 206, 207, 207 a to cause the translating members ofthe linkages to move to apply a portion of the clamping force via thesoft robotic fingers 100 to the same second article (e.g., article 402,406, and/or 408). The controller 136 may further be configured in thethird mode to successively actuate one of the linkage actuators 206,207, 207 a or the finger actuators 120, then the remaining one of thelinkage actuators 206, 207, 207 a or the finger actuators 120 to combinethe portion of the clamping force and the grasping force. The controllermay be alternatively or in addition configured in the third mode tosimultaneously actuate the linkage actuators 206, 207, 207 a and thefinger actuators 120 to combine the portion of the clamping force andthe grasping force.

When applying the clamping force and the grasping force to a samearticle (e.g., via the fingers 100) the controller soft robotic systemaccording to claim 19, the controller 136 may be further configured inthe third mode to maintain the grasping force and clamping force in apredetermined relationship to one another.

In another implementation of multiple modes, employing the grip pads 208as integrated to any capable one of the structures discussed herein, thecontroller 136 may be configured to activate the linkage actuators 206,207, 207 a to cause the translating members of the linkages to move toapply the clamping force to an article (e.g., article 402, 406, and/or408), and to activate the finger actuators to cause the soft roboticfingers to curl to apply a grasping force to the same article (e.g.,article 402, 406, and/or 408). The controller 136 may be configured to,in a first mode, successively actuate one of the linkage actuators 206,207, 207 a or the finger actuators 120, then the remaining one of thelinkage actuators 206, 207, 207 a or the finger actuators 120 to combinethe clamping force and the grasping force, and in a second mode,simultaneously actuate the linkage actuators 206, 207, 207 a and thefinger actuators 120 to combine the clamping force and the graspingforce. Again, the controller 136 may be is further configured tomaintain the grasping force and clamping force in a predeterminedrelationship to one another.

With these structures, with or without the grip pads 208 or linkageactuation via actuators 206, 207, 207 a, the suction cup 304, mounted onthe extension actuator, may be configured to apply a vacuum force to thearticle. The suction cup 304 may creating a vacuum force when thesuction cup actuator applies a second pressure change (independent ofthe finger 100 pressure change). In this case, the controller 136 may befurther configured in an additional mode, activate the suction cupactuator and extension actuator to cause the suction cup to contact thearticle, lift the article by the vacuum force, and retract the articletoward the hub 202. In this case, the controller 136 may be furtherconfigured to complete this suction cup mode before the first or secondmode previously described.

Alternatively, or in addition, the controller 136 may be configured toemploy the suction cup mode as a primary mode, and in a first mode,activate the suction cup actuator and extension actuator to cause thesuction cup 304 to contact the article, lift the article by the vacuumforce, and retract the article toward the hub, and in a second mode,activate the finger actuator 120 to cause the soft robotic fingers tocurl to apply a grasping force to the article. In this case, thecontroller may, complete the first mode before the second mode.Alternatively, or in additional mode, the controller 136 may start thesecond mode before the first mode completely retracts the article towardthe hub.

General Notes on Terminology

Some embodiments may be described using the expression “one embodiment”or “an embodiment” along with their derivatives. These terms mean that aparticular feature, structure, or characteristic described in connectionwith the embodiment is included in at least one embodiment. Theappearances of the phrase “in one embodiment” in various places in thespecification are not necessarily all referring to the same embodiment.Moreover, unless otherwise noted the features described above arerecognized to be usable together in any combination. Thus, any featuresdiscussed separately may be employed in combination with each otherunless it is noted that the features are incompatible with each other.

With general reference to notations and nomenclature used herein, thedetailed descriptions herein may be presented in terms of programprocedures executed on a computer or network of computers. Theseprocedural descriptions and representations are used by those skilled inthe art to most effectively convey the substance of their work to othersskilled in the art.

A procedure is here, and generally, conceived to be a self-consistentsequence of operations leading to a desired result. These operations arethose requiring physical manipulations of physical quantities. Usually,though not necessarily, these quantities take the form of electrical,magnetic or optical signals capable of being stored, transferred,combined, compared, and otherwise manipulated. It proves convenient attimes, principally for reasons of common usage, to refer to thesesignals as bits, values, elements, symbols, characters, terms, numbers,or the like. It should be noted, however, that all of these and similarterms are to be associated with the appropriate physical quantities andare merely convenient labels applied to those quantities.

Further, the manipulations performed are often referred to in terms,such as adding or comparing, which are commonly associated with mentaloperations performed by a human operator. No such capability of a humanoperator is necessary, or desirable in most cases, in any of theoperations described herein, which form part of one or more embodiments.Rather, the operations are machine operations. Useful machines forperforming operations of various embodiments include general purposedigital computers or similar devices.

Some embodiments may be described using the expression “coupled” and“connected” along with their derivatives. These terms are notnecessarily intended as synonyms for each other. For example, someembodiments may be described using the terms “connected” and/or“coupled” to indicate that two or more elements are in direct physicalor electrical contact with each other. The term “coupled,” however, mayalso mean that two or more elements are not in direct contact with eachother, but yet still co-operate or interact with each other.

Various embodiments also relate to apparatus or systems for performingthese operations. This apparatus may be specially constructed for therequired purpose or it may comprise a general purpose computer asselectively activated or reconfigured by a computer program stored inthe computer. The procedures presented herein are not inherently relatedto a particular computer or other apparatus. Various general purposemachines may be used with programs written in accordance with theteachings herein, or it may prove convenient to construct morespecialized apparatus to perform the required method steps. The requiredstructure for a variety of these machines will appear from thedescription given.

In the foregoing description, it can be seen that various features aregrouped together in a single embodiment for the purpose of streamliningthe disclosure. This method of disclosure is not to be interpreted asreflecting an intention that the claimed embodiments require morefeatures than are expressly recited in each claim. Rather, as thefollowing claims reflect, inventive subject matter lies in less than allfeatures of a single disclosed embodiment. Thus the following claims arehereby incorporated into the Detailed Description, with each claimstanding on its own as a separate embodiment. In the appended claims,the terms “including” and “in which” are used as the plain-Englishequivalents of the respective terms “comprising” and “wherein,”respectively. Moreover, the terms “first,” “second,” “third,” and soforth, are used merely as labels, and are not intended to imposenumerical requirements on their objects.

What has been described above includes examples of the disclosedarchitecture. It is, of course, not possible to describe everyconceivable combination of components and/or methodologies, but one ofordinary skill in the art may recognize that many further combinationsand permutations are possible. Accordingly, the novel architecture isintended to embrace all such alterations, modifications and variationsthat fall within the spirit and scope of the appended claims.

Any or all of the above-described techniques may be implemented bysuitable hardware, including pneumatic, hydraulic, mechanical,electrical, magnetic, etc. hardware. Some embodiments may utilize logicstored on a non-transitory computer-readable medium. When executed byone or more processors, the logic may cause the processors to performthe techniques identified above. The logic may be implemented fully orpartially in hardware. The logic may be included as part of a controllerfor controlling the actuation, de-actuation, movement, position, etc. ofa soft robotic actuator and/or a soft robotic system employing one ormore actuators in a gripper arrangement.

As used herein, structures, acts, steps, and functions are given variousnames or labels. This paragraph describes terminology that is usedalternatively, in some cases interchangeably, and in some casesequivalently. Generally, one of skill in the art will recognize andunderstand identity, equivalency, and the similarities and differencesamong alternative terms of art and/or words having a plain technicalmeaning. As used herein, an end effector may include an effectorincluding a tool or one to which a tool may be mounted, including EOAT202 and the like. Bendable members may include soft robotic members suchas soft robotic actuators 100.

We claim:
 1. A soft robotic grasping system for grasping an article,comprising: a gripper hub; a finger actuator that applies a pressurechange; a plurality of soft robotic fingers supported by the hub, eachsoft robotic finger including an elastomeric outer surface surroundingan internal void, and each soft robotic finger being configured to curlwhen the finger actuator applies the pressure change within the internalvoid; a camera having a field of view configured to observe the softrobotic fingers in any of an ungrasped, article grasping, and emptygrasping state; and a controller connected to the camera and the fingeractuator, configured to compare an observation of the soft roboticfingers to a reference state to determine an ungrasped, article graspingor empty grasping state of the soft robotic fingers, the controllerinstructing the finger actuator to apply pressure to change from anempty grasping state to an ungrasped state after the empty graspingstate is determined.
 2. The soft robotic grasping system according toclaim 1, wherein the gripper hub has an axial center region about anaxial center line, and the camera is positioned in the axial centerregion and is configured to direct the optical axis of the camera alongthe axial center line.
 3. The soft robotic grasping system according toclaim 1, further comprising: an astrictive effector configured to applyan astrictive force; and an extension linkage connecting the astrictiveeffector and the hub, the extension linkage being configured to extendand retract the astrictive effector along a direction perpendicular tothe grasping direction, the controller configured to compare anobservation of the soft robotic fingers and/or extension linkage to atleast one reference state to determine whether the article issuccessfully grasped.
 4. The soft robotic grasping system according toclaim 1, further comprising: at least one linkage connecting each softrobotic finger to the hub, each linkage being configured to change apose of the connected soft robotic finger relative to the hub, whereinthe camera having a field of view and focus are configured to observethe soft robotic fingers in a plurality of poses of the connected softrobotic finger relative to the hub.
 5. The soft robotic grasping systemaccording to claim 1, wherein the reference state includes apredetermined proportion of the field of view corresponding to arecognized characteristic of the soft robotic fingers in the emptygrasping state.
 6. A soft robotic grasping system for grasping anarticle, comprising: a gripper hub; a finger actuator that applies apressure change; a plurality of soft robotic fingers, each soft roboticfinger being arranged along a grasping direction and including anelastomeric outer surface surrounding an internal void, and each softrobotic finger being configured to curl in a first degree of freedomalong the grasping direction when the finger actuator applies thepressure change within the internal void; an astrictive effectorconfigured to apply an astrictive force; an extension linkage connectingthe astrictive effector and the hub, the extension linkage beingconfigured to extend and retract the astrictive effector along adirection perpendicular to the grasping direction; a camera having afield of view configured to observe the soft robotic fingers in any ofan ungrasped, article grasping, and empty grasping state and theextension linkage in unextended and extended states; and a controllerconnected to the camera, the controller configured to compare anobservation of the soft robotic fingers and/or extension linkage to atleast one reference state to determine whether the article issuccessfully grasped.
 7. The soft robotic grasping system according toclaim 6, wherein the gripper hub has an axial center region about anaxial center line, the camera is positioned in the axial center regionand is configured to direct the optical axis along the axial centerline, and the astrictive effector and extension linkage are positionedadjacent the axial center region and configured to direct the extensionof the astrictive effector parallel to the axial center line.
 8. Thesoft robotic grasping system according to claim 6, further comprising: aplurality of linkages, each linkage respectively connecting a softrobotic finger to the hub, each linkage being configured to change apose of the connected soft robotic finger relative to the hub; and aplurality of linkage actuators configured to cause the linkages to move,each linkage actuator respectively connected to one of the linkages. 9.A soft robotic grasping system, comprising: a gripper hub having anaxial center region about an axial center line, a plurality of graspingdirections being radially symmetric about the axial center line, and aplurality of accessory directions being defined between adjacentgrasping directions; a finger actuator that applies a pressure change; aplurality of soft robotic fingers, each soft robotic finger beingarranged along a grasping direction and including an elastomeric outersurface surrounding an internal void, and each soft robotic finger beingconfigured to curl in a first degree of freedom along the graspingdirection when the finger actuator applies the pressure change withinthe internal void; a first accessory acting along the axial center linebeing positioned in the axial center region; and a second accessoryacting parallel to the axial center line being positioned along anaccessory direction adjacent the axial center region, wherein the firstand second accessories are selected from a vacuum chuck extendible in adirection parallel to the axial center line, a camera having an opticalaxis extending in a direction parallel to the axial center line, and arange finder having a ranging axis extending in a direction parallel tothe axial center line.
 10. The soft robotic grasping system according toclaim 9, wherein the camera is positioned in the axial center region andis configured to direct the optical axis along the axial center line,and the vacuum chuck is positioned adjacent the axial center region andconfigured to extend in the direction parallel to the axial center line.11. The soft robotic grasping system according to claim 9, furthercomprising: a plurality of linkages, each linkage respectivelyconnecting a soft robotic finger to the hub, and each linkage beingconfigured to change a pose of the connected soft robotic finger alongthe grasping direction.
 12. The soft robotic grasping system accordingto claim 11, further comprising: a plurality of linkage actuatorsconfigured to cause the linkages to move, each linkage actuatorrespectively connected to one of the linkages.
 13. A soft roboticgrasping system for grasping an article, comprising: a gripper hub; aplurality of soft robotic fingers, each soft robotic finger including anelastomeric outer surface surrounding an internal void, and each softrobotic finger being configured to curl in a first degree of freedomwhen the finger actuator applies the pressure change within the internalvoids; a plurality of linkages, each linkage respectively connecting asoft robotic finger to the hub, each linkage being configured to guidein a second degree of freedom to change a pose of the connected softrobotic finger relative to the hub; a plurality of linkage actuatorsconfigured to cause the linkages to move, each linkage actuatorrespectively connected to one of the linkages; and a camera having afield of view configured to observe the soft robotic fingers in any ofan ungrasped, article grasping, and empty grasping state; and acontroller connected to the camera, the controller configured to comparean observation of the soft robotic fingers to at least one referencestate to determine whether the article is successfully grasped.
 14. Thesoft robotic grasping system according to claim 13, further comprising:an astrictive effector configured to apply an astrictive force; anextension linkage connecting the astrictive effector and the hub, theextension linkage being configured to extend and retract the astrictiveeffector along a direction perpendicular to the grasping direction,wherein the camera is further configured to observe the extensionlinkage in unextended and extended states; and a controller connected tothe camera, the controller configured to compare an observation of theextension linkage to at least one reference state.
 15. The soft roboticgrasping system according to claim 13, wherein the at least onereference state includes a predetermined proportion of the field of viewcorresponding to a recognized characteristic of the soft robotic fingersin at least one of the ungrasped, article grasping, and empty graspingstate.
 16. A soft robotic grasping system for grasping an article,comprising: a finger actuator that applies a pressure change; aplurality of soft robotic fingers, each soft robotic finger including anelastomeric outer surface surrounding an internal void, and each softrobotic finger being configured to curl in a first degree of freedomwhen the finger actuator applies the pressure change within the internalvoids; a plurality of linkages, each linkage respectively connecting asoft robotic finger to the hub, each linkage being configured to guidethe connected soft robotic finger in a second degree of freedom tochange a pose of the connected soft robotic finger relative to the hub;a plurality of grip pads, each grip pad respectively connected to atranslating member of a linkage, each grip pad being configured to applya clamping force when the translating member is moved; a plurality oflinkage actuators configured to cause the linkages to move, each linkageactuator respectively connected to one of the linkages; and a controllerconfigured to, in a first mode, activate the linkage actuators to causethe translating members of the linkages to move to apply the clampingforce to a first article, and in a second mode, activate the fingeractuator to cause the soft robotic fingers to curl to apply a graspingforce to a second article.
 17. The soft robotic system according toclaim 16, wherein the controller is further configured, in a third mode,to activate the finger actuator to cause the soft robotic fingers tocurl to apply the grasping force to the second article and activate thelinkage actuators to cause the translating members of the linkages tomove to apply a portion of the clamping force via the soft roboticfingers to the same second article.
 18. The soft robotic systemaccording to claim 17, wherein the controller is further configured inthe third mode to successively actuate one of the linkage actuators orthe finger actuators then the remaining one of the linkage actuators orthe finger actuators to combine the portion of the clamping force andthe grasping force.
 19. The soft robotic system according to claim 17,wherein the controller is further configured in the third mode tosimultaneously actuate the linkage actuators and the finger actuators tocombine the portion of the clamping force and the grasping force. 20.The soft robotic system according to claim 19, wherein the controller isfurther configured in the third mode to maintain the grasping force andclamping force in a predetermined relationship to one another.
 21. Asoft robotic grasping system for grasping an article, comprising: afinger actuator that applies a pressure change; a plurality of softrobotic fingers, each soft robotic finger including an elastomeric outersurface surrounding an internal void, and each soft robotic finger beingconfigured to curl in a first degree of freedom when the finger actuatorapplies the pressure change within the internal voids; a plurality oflinkages, each linkage respectively connecting a soft robotic finger tothe hub, each linkage being configured to guide the connected softrobotic finger in a second degree of freedom to change a pose of theconnected soft robotic finger relative to the hub; a plurality of grippads, each grip pad respectively connected to a translating member of alinkage, each grip pad being configured to apply a clamping force whenthe translating member is moved; a plurality of linkage actuatorsconfigured to cause the linkages to move, each linkage actuatorrespectively connected to one of the linkages; and a controllerconfigured to activate the linkage actuators to cause the translatingmembers of the linkages to move to apply the clamping force to anarticle, and to activate the finger actuators to cause the soft roboticfingers to curl to apply a grasping force to the article, the controllerbeing configured to, in a first mode, successively actuate one of thelinkage actuators or the finger actuators then the remaining one of thelinkage actuators or the finger actuators to combine the clamping forceand the grasping force, and in a second mode, simultaneously actuate thelinkage actuators and the finger actuators to combine the clamping forceand the grasping force.
 22. The soft robotic system according to claim20, wherein the controller is further configured to maintain thegrasping force and clamping force in a predetermined relationship to oneanother.
 23. The soft robotic system according to claim 20, furthercomprising: a suction cup configured to apply a vacuum force to thearticle, the suction cup being mounted to the extension actuator andconfigured to move toward or away from the hub, the suction cup creatinga vacuum force when the suction cup actuator applies the second pressurechange, wherein the controller is further configured to, in a thirdmode, activate the suction cup actuator and extension actuator to causethe suction cup to contact the article, lift the article by the vacuumforce, and retract the article toward the hub.
 24. The soft roboticsystem according to claim 23, wherein the controller is furtherconfigured to complete the third mode before the first or second mode.25. The soft robotic system according to claim 23, wherein the linkagesmove to apply a portion of the clamping force and the grasping force viathe soft robotic fingers to a same article.
 26. A soft robotic graspingsystem for grasping an article, comprising: a gripper hub; a fingeractuator that applies a first pressure change; a suction cup actuatorthat applies a second pressure change; an extension actuator thatextends away from or retracts toward the hub; a plurality of softrobotic fingers, each soft robotic finger including an elastomeric outersurface surrounding an internal void, and each soft robotic finger beingconfigured to curl in a first degree of freedom when the finger actuatorapplies the pressure change within the internal voids; a suction cupconfigured to apply a vacuum force to the article, the suction cup beingmounted to the extension actuator and configured to move toward or awayfrom the hub, the suction cup creating a vacuum force when the suctioncup actuator applies the second pressure change; and a controllerconfigured to, in a first mode, activate the suction cup actuator andextension actuator to cause the suction cup to contact the article, liftthe article by the vacuum force, and retract the article toward the hub,and in a second mode, activate the finger actuator to cause the softrobotic fingers to curl to apply a grasping force to the article. 27.The soft robotic system according to claim 26, wherein the controller isfurther configured to, in a third mode, complete the first mode beforethe second mode.
 28. The soft robotic system according to claim 26,wherein the controller is further configured to, in a fourth mode, startthe second mode before the first mode completely retracts the articletoward the hub.
 29. The soft robotic system according to claim 26,further comprising: a camera having a field of view configured toobserve the soft robotic fingers in any of an ungrasped, articlegrasping, and empty grasping state, wherein the controller is furtherconfigured to compare an observation of the soft robotic fingers to areference state to determine an ungrasped, article grasping or emptygrasping state of the soft robotic fingers.
 30. The soft robotic systemaccording to claim 26, wherein the field of view of the camera isfurther configured to observe the suction cup in retracted and extendedstates of the extension actuator, and the controller is furtherconfigured to compare an observation of the suction cup to at least onereference state to determine whether the article is successfully lifted.